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Life Skills Training Program 
Executive Summary 



Approximately 510,000 children lived in out-of-home care on September 30, 2006, the most recent 
date for which national estimates are available. In fiscal year 2006, over 26,000 youths remained in 
care until they were legally “emancipated” to “independent living,” usually due to reaching the age of 
majority or upon graduation from high school. On average, these youth have limited education and 
employment experience, relatively poor mental and physical health, and a relatively high likelihood of 
experiencing unwanted outcomes such as homelessness, incarceration, and nonmarital pregnancy. 

The Foster Care Independence Act of 1999 amended Title IV-E to create the John Chafee Foster Care 
Independence Program (CFCIP), giving states more funding and greater flexibility in providing 
support to youth making the transition to independent living. It also required evaluation of such 
services. The U.S. Department of Health and Human Services’ Children’s Bureau contracted with the 
Urban Institute and its partners — the Chapin Hall Center for Children and the National Opinion 
Research Center at the University of Chicago — to conduct this evaluation. The goal of this study is to 
determine the effects of the programs funded under CFCIP in achieving key outcomes for youth. Four 
programs are being evaluated under this contract. The subject of this report is the Life Skills Training 
(LST) program of Los Angeles County. 1 



Description of the Life Skills Training Program 

The Life Skills Training program is similar in many respects to services provided in numerous 
locations throughout the United States (i.e., classroom- and practicum-based training), though there are 
special aspects as well. There is an extensive outreach component, and the community college locale 
enables youths to be served in their communities and also exposed to community college campuses. 
The program serves a large number of youth and was oversubscribed for service, having nearly twice 
as many youths referred as program participants. 

The five-week curriculum consists of ten three-hour classes held twice a week in 19 community 
colleges throughout Los Angeles County. The program is based on seven state-adopted competency 
skill areas: education, employment, daily living skills, survival skills, choices and consequences, 
interpersonal/social skills, and computer/Internet skills. Instructors have the flexibility to design their 
own classes and activities, invite guest speakers, and use experiential methods to impart information. 
Pre- and post-test assessments are provided to evaluate whether a youth has made progress in skill 
acquisition. In addition, an outreach component is staffed with 20 full- and part-time workers dedicated 
to recruiting youths into the classes. Outreach advisors are responsible for recruiting youths, providing 
short-term case management, and documenting services. Outreach advisors assess the youths with the 
Ansell-Casey assessment tool as well as other tools at the beginning and end of the class modules. 
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The Life Skills Training Program offered through the Community College Foundation is not related to or based on the 
LifeSkills Training substance abuse prevention program. 




The Evaluation 



The evaluation consists of two components: an impact study involving three in-person interviews over 
two years and a process study. The sample consists of youths who were in out-of-home care 
placements and were 17 years old at the time of assignment, eligible for Chafee services, and deemed 
appropriate for Life Skills Training. A total of 482 youths were deemed eligible for the evaluation and 
234 were assigned to the LST (treatment) group, while 248 youths were assigned to the control group. 
At the baseline, 97 percent of eligible cases were interviewed, and 88 percent of these were 
interviewed at the second follow-up. Overall, 76.5 percent of the 234 youths in the LST group enrolled 
in an LST classroom module, 70.1 percent attended a session, and 65 percent graduated from a 
module. 

As in other field experiments involving social services where the control over program receipt is not 
complete, some members of the control group received services (e.g., attended one or more LST class 
sessions). Specifically, according to administrative records, 26.6 percent of the 248 youths in the 
control group enrolled in the program, 25 percent attended at least one class, and 22.6 percent 
graduated from the program. The levels of reported receipt of most independent living services by the 
second follow-up did not differ significantly between assignment groups. 



Impact Findings 

Concrete measures of the transition to adulthood were examined. Education and employment measures 
include completion of a high school diploma or general equivalency diploma and current employment 
status. Economic well-being was measured by reported earnings and current net worth, economic 
hardship, and receipt of formal and informal financial assistance. Youths were also asked how 
prepared they felt in 18 areas of adult living and in obtaining a job. Finally, the evaluation considered 
youths’ housing, including residential stability and homelessness, as well as delinquency, pregnancy, 
and receipt of needed documentation (e.g., Social Security card) and accounts (e.g., a bank or savings 
account). 

The impact evaluation found few impacts on any outcome assessed. After adjusting significance levels 
to account for the possibility of false positive results, no significant impacts remained. While the 
problems encountered in trying to conduct a random- assignment evaluation of LST require more 
complex analyses than would be the case if the evaluation had fewer violations of random assignment, 
the evaluation findings give no reason to believe that LST had a significant positive impact on any of 
the concrete indicators of successful transition to adulthood (e.g., educational attainment, employment, 
earnings, and avoidance of economic hardship). 



Lessons for Independent Living Programs 

The large percentage of foster youths who reported receipt of help in acquiring various kinds of life 
skills from sources other than LST calls into question whether classroom-based life skills training can 
add much to what foster youths are already obtaining from other sources. In addition, for most youths, 
it appears that independent living assistance comes from a variety of sources. Although the most 
commonly reported sources of independent living assistance included biological parents or other 
original family members and teachers and schools, sizable proportions of youths reported receiving 
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assistance from foster parents, caseworkers, and independent living programs. Child welfare 
authorities would be wise to assess how available these other sources of help are to youth in their 
jurisdictions when considering investing in classroom-based life skills training. 

The evaluation calls into question the notion that classroom-based life skills training, in and of itself, is 
likely to have much impact on the well-being of foster youth in transition to adulthood. Child welfare 
authorities should not expect classroom-based life skills training to suffice as a strategy to prepare 
foster youth for adulthood. 

Our evaluation provides strong evidence that foster youth are already getting some of this kind of help 
from their foster care providers, though there is room for improvement. Further research should be 
conducted to understand the degree to which foster youth acquire independent living skills from their 
caregivers and whether knowledge thus gained is more enduring than knowledge gained through 
classroom-based training. In addition, promising approaches to training foster care providers in 
teaching independent living skills and supporting them in such efforts should be rigorously evaluated. 
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Chapter 1. Introduction 
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Introduction 



Approximately 510,000 children lived in out-of-home care as of September 30, 2006, the most 
recent date for which national estimates are available (U.S. Department of Health and Human 
Services [DHHS] 2008). This represents about six children and adolescents per thousand. The 
vast majority of children and youth will exit care to what are considered permanent placements. 
Of the estimated 289,000 children who left out-of-home care in the United States during fiscal 
year 2006, 86 percent went to live with family, were adopted, or were placed in the home of a 
legal guardian (DHHS 2008). A few (2 percent) were transferred to another public agency, such 
as a probation or mental health department, and a few (2 percent) ran away and were discharged 
from care. Nine percent, or 26,517, remained in care until they were legally “emancipated” to 
“independent living,” usually due to reaching the age of majority or upon graduation from high 
school. In practice, few states allow youth to remain in care much past their 18th birthday 
(Bussey et al. 2000). About 5 percent (21,834) of all children and youths living in out-of-home 
care were between 18 and 21 years old. 

Research findings suggest that the transition to adulthood for foster youth in the United States is 
difficult. On average, they have had poor educational experiences, leading them to bring to the 
transition very limited human capital upon which to build a career or economic assets. They also 
often suffer from mental health problems that can negatively affect other outcome domains, and 
these problems are less likely to be treated once youth leave care. In addition, foster youth 
frequently become involved in crime and with the justice and corrections systems after aging out 
of foster care. Further, their employment prospects are bleak, and few of them escape poverty 
during the transition. At the same time, many former foster youth experience homelessness and 
housing instability after leaving care. Compared with their peers, former foster youth have higher 
rates of out-of-wedlock parenting. Interestingly, in spite of court-ordered separation from their 
families, often for many years, most former foster youth rely on their families to some extent 
during the transition to adulthood, though this is not always without risk (Barth 1990; Bussey et 
al. 2000; Cook, Fleischman, and Grimes 1991; Courtney et al. 2001; Courtney et al. 2005; 
Dworsky and Courtney 2000; Fanshel, Finch, and Grundy 1990; Festinger 1983; Frost and Jurich 
1983; Goerge et al. 2002; Harari 1980; Jones and Moses 1984; Mangine et al. 1990; Pecora et al. 
2005; Pettiford 1981; Sosin, Coulson, and Grossman 1988; Sosin, Piliavin, and Westerfeldt 
1990; Susser et al. 1991; Zimmerman 1982). 

These poor outcomes suggest the need for services to better prepare foster youth for the 
transition to adulthood. Two decades ago, there were few such services. Numerous independent 
living services have been developed since then as federal funding for independent living services 
has increased. A recent review by Montgomery et al. (2006) found that no rigorous evaluations 
of such services have been conducted. Rigorous evaluation of various independent living 
services is needed to inform efforts to improve their effectiveness. 

This report presents findings from a rigorous evaluation of the Life Skills Training Program 
(LST) in Los Angeles County. 2 ' 3 LST provides 30 hours of life skills training over five weeks to 



The Life Skills Training Program is operated by The Community College Foundation (TCCF). TCCF is a 
nonprofit organization in California that provides a range of programs to support educational technology, 
internship, scholarship, and at-risk youth initiatives. TCCF’s Pluman Development and Youth Services division 
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foster youths ages 16 and older. The classes are held on community college campuses throughout 
Los Angeles County. The program is staffed by workers tasked with conducting outreach to 
youths to engage them in the program and providing some case management. We examine the 
program’s implementation and its impact on the youths served with a rigorous random- 
assignment method with a two-year follow-up. This is one of the impact reports from a four-site 
study required by the Foster Care Independence Act of 1999, funded by the Children’s Bureau 
and directed by the Children’s Bureau and the Office of Planning, Research, and Evaluation in 
the U.S. Department of Health and Human Services. 

This work is important for several reasons. First, the work confirms that youth who age out of 
foster care are not doing well and need further attention from the systems that have served them 
before they turned 18 years old. Second, child welfare systems can and should rigorously test 
interventions using the best possible evaluation methods. It is possible to conduct rigorous 
evaluation in the child welfare system, and it is crucial to do so if the field is to develop services 
that address the great needs of its children and youth. Finally, it is especially important to do this 
work now. The field has developed a significant number of new services in the past few decades, 
but without rigorous evaluation it is impossible to know what is truly helping the children and 
families in the child welfare system. 

In the remainder of this chapter, we provide an overview of the Chafee legislation and the 
evaluation purpose, as well as site selection for the evaluation and research questions for the 
study. We also review the research design and methodology for both the impact and process 
studies. In chapter 2, we describe the FST program using information obtained as part of the 
process study component of the evaluation. Chapter 3 provides an overview of the evaluation’s 
implementation, including a discussion of service take-up, sample development, and a 
description of the sample. Results of the evaluation’s impact study are discussed in chapter 4. A 
discussion of process study findings that shed light on the impact findings is also presented in 
chapter 4. Finally, chapter 5 provides a discussion of the findings of the evaluation and how it 
relates to the broader field of independent living programs. 



Overview of Legislation and Evaluation Purpose 

The Foster Care Independence Act (FCIA) of 1999 (Public Faw 106-169) amended Title IV-E of 
the Social Security Act to create the John Chafee Foster Care Independence Program (CFCIP), 
giving states more funding and greater flexibility in providing support for youth making the 
transition to independent living. The FCIA allocates $140 million per year in independent living 
services funding to states, allows states to use up to 30 percent of these funds for room and 
board, enables states to assist young adults between the ages of 18 and 21 who have left foster 
care, and permits states to extend Medicaid eligibility to former foster children up to age 21. 

State performance is a much higher priority under the FCIA than under earlier iterations of 
federal policy in this area. The U.S. Department of Health and Human Services is required to 



offers programs at 49 community colleges throughout the state, 19 of which are in Los Angeles County, and 
reaches more than 14,000 youths and adults annually. 

3 The Life Skills Training Program offered through The Community College Foundation is not related to or based 
on the LifeSkills Training substance abuse prevention program. 
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develop a set of outcome measures to assess state performance in managing independent living 
programs, and states are required to collect data on these outcomes. In addition, the FCIA 
requires that funding under the statute be set aside for evaluations of promising independent 
living programs: 

The Secretary shall conduct evaluations of such State programs funded under this 
section as the Secretary deems to be innovative or of potential national 
significance. The evaluation of any such program shall include information on the 
effects of the program on education, employment, and personal development. To 
the maximum extent practicable, the evaluations shall be based on rigorous 
scientific standards including random assignment to treatment and control groups. 

The Secretary is encouraged to work directly with State and local governments to 
design methods for conducting the evaluations, directly or by grant, contract, or 
cooperative agreement (Title IV-E, Section 477 [42 U.S.C. 677], g, 1). 

The language in the FCIA requiring rigorous evaluation of independent living programs reflects 
the acknowledgment by lawmakers that little is known about the effectiveness of independent 
living programs. In response to this language, the Department of Health and Human Services’ 
Children’s Bureau has contracted with the Urban Institute and its partners — the Chapin Hall 
Center for Children and the National Opinion Research Center — to conduct an evaluation of 
selected programs funded through the CFCIP, the Multi-Site Evaluation of Foster Youth 
Programs. The goal is to determine the effects of independent living programs funded under 
CFCIP in achieving key outcomes for participating youths, including increased educational 
attainment, higher employment rates and stability, better interpersonal and relationship skills, 
fewer nonmarital pregnancies and births, and reduced rates of delinquency and crime. 



Program Site Selection 

In 2001, the Department of Health and Human Services contracted with the Urban Institute and 
its partners to conduct an evaluability assessment of independent living programs. The goal of 
this assessment was to identify programs that could be rigorously evaluated and to develop 
evaluation designs that would meet the requirements of the authorizing legislation. The 
evaluation team — in coordination with the Children’s Bureau and a federally-appointed technical 
work group — established criteria for selecting sites for the evaluability assessment. The 
Children’s Bureau selected programs to be evaluated. 

To be considered for the evaluation, programs were required to exhibit the following: 

• Programs should take in sufficient numbers of youths to allow for the creation of a 
research sample of adequate size. 

• Programs should have excess demand for services so that randomly assigning youths to a 
control group is possible while serving the same number of youths. 

• Programs should be reasonably stable. 
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• Programs should be relatively intensive. 

• Programs should have well-developed theories of intervention (“logic models”), linking 
intended outcomes with intervention activities. 

• Programs should be consistently implemented. 

• Sites should have available data with which to understand the flow of clients and to 
follow clients to assess key outcomes. 

• Relevant decisionmakers should be willing to support participation in a rigorous 
evaluation. 

• Program sites should be willing to make minor changes needed to accommodate the 
research and should be able to maintain them for the full research period. 

The evaluation team conducted this assessment to identify programs suitable for evaluation 
between October 2001 and January 2003 and involved the following: 

• identifying independent living programs in the United States; 

• developing information on critical aspects of these programs; 

• categorizing the programs; 

• selecting programs for further study; 

• visiting the selected programs; 

• applying the criteria for evaluability to selected programs; and 

• recommending programs for evaluation. 

Thirty-two states and the District of Columbia were contacted and 87 different independent 
living programs were examined. Site visits were conducted with the 23 programs that seemed 
most promising. Most of the programs did not meet the basic criteria for evaluability; that is, 
most did not have sufficient program intake to allow the creation of a research sample of 
adequate size or the excess demand that makes random assignment possible while serving the 
same number of youths. 

Four independent living programs were selected for inclusion in the evaluation, which used a 
random-assignment design. The selected programs encompass a set of critical independent living 
services and represent a range of program types. The programs include an employment services 
program in Kern County, California, modeled on Temporary Assistance for Needy Families 
work development assistance; an intensive case management and mentoring program in 
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Massachusetts; a tutoring and mentoring program; and a classroom-based life skills training 
program, both serving youths in Los Angeles County. Note that these four programs are not 
representative of all of the different types of independent living services available to youth in the 
United States. Rather, they represent a range of different interventions that independent living 
programs use. As a result, the findings from the Multi-Site Evaluation cannot be generalized to 
all independent living programs. It is also important to note that the study team attempted to 
identify a housing program to evaluate and investigated several different housing programs 
located throughout the country. However, low numbers of participants in these programs made 
random assignment difficult and would not provide sufficient samples for the analyses. 

The LST program provides a service (life skills training classes) commonly provided throughout 
the United States. Although LST may provide a typical set of services, there are unusual aspects 
of the program that may provide useful information for other independent living programs. At 
the time of the evaluation, 19 community colleges throughout Los Angeles County offered the 
LST program, enabling youth to be served in their communities while being exposed to 
community college campuses. The outreach component was unusual in that many life skills 
programs do not have staff dedicated to recruiting and engaging youth. The program had roughly 
20 full- and part-time staff members dedicated to recruiting youths into the classes. Aside from 
programmatic aspects, the program was selected because of the large number of youths that it 
serves (nearly 600 annually at the time of the assessment). LST is an oversubscribed service, 
having nearly twice as many referrals as program participants. 



Research Questions 

In addressing the goals of the Chafee legislation, the Multi-Site Evaluation addressed the 
following research questions. 

• Program impacts: What impact does access to the identified intervention have for youth 
compared with similar youth who have access to standard services or “services as usual” 
on key outcomes like self-sufficiency and well-being (e.g., educational skills, 
interpersonal skills, living skills, employment skills, psychosocial well-being)? 

• Program mission: How does the program identify its logic model? Does service 
implementation follow the logic model and mission? 

• Service implementation: How are services implemented? Who performs the service 
delivery? What is the training and experience of staff delivering services? 

• Who is being served: What types of youth are being served? Is there an assessment 
protocol to determine the types and duration of services needed? Who is excluded? Do 
the intended populations receive services? 

• Program challenges: What are barriers to implementation? 
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• Policy variables: How might external community or state-level variables contribute to 
outcomes achieved by program participants? 

• Portability of program models: To what extent might these programs be adapted to other 
locales? How transportable are these services and program models to other programs in 
other regions? 



Research Design and Methods 

This evaluation used an experimental design, whereby some youths were randomly referred to 
the service being evaluated, while others were referred to standard services or “services as 
usual.” Youths assigned to the group referred to the service, or treatment group, are referred to as 
“LST group youth.” Youths that were not assigned to receive the service, but rather to receive 
services as usual, are referred to as “control group youth.” Chapter 3 contains a more detailed 
description of the random-assignment process and LST and control groups. The evaluation 
consists of two elements: an impact study and a process study. To determine the effects of 
independent living programs on the key outcomes required by the Chafee legislation, youths in 
both the LST and control groups were interviewed in person at three points over the course of the 
evaluation. For the process study, members of the evaluation team visited the sites to observe the 
programs and conduct interviews and focus groups with youths, staff, administrators, and service 
providers. A more in-depth description of the evaluation methodology appears in appendix A. 

Impact Study 

The main source of data for identifying program impacts comes from interviews with foster 
youths. For the LST evaluation, we drew samples of eligible youths and randomly assigned each 
youth to either the LST (treatment) or control groups. Our target was to interview a total of 450 
youths across the LST and control groups at the baseline. Each respondent was asked to 
participate in an initial interview and two follow-up interviews, with expected first and second 
follow-up retention rates of 85 and 80 percent, respectively. Each follow-up interview was to 
take place approximately one year after the previous interview with that respondent. 

Sample Overview . The LST analysis sample consists of 467 youths bom March 1986 to 
February 1987. The youths were in foster care placements under the guardianship of the Los 
Angeles County Department of Child and Family Services. To be in scope for the study, the 
youths had to be 17 years old, in out-of-home care, eligible for Chafee services, and deemed able 
to benefit from life skills training. 4 We chose to include 17-year-olds based on conversations 
with program staff. They felt that those younger than age 17 are difficult to engage in thinking 
about independent living. Also, with more youths referred than can be served, they prioritize 
those youths who are closest to emancipation age. 



The determination that a youth would not benefit from services is made by the Department of Child and Family 
Services and according to its policy means that the youth is physically or mentally unable to benefit from 
independent living services. 
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Data collection far exceeded our expected response rates. We completed baseline interviews with 
nearly 97 percent of the in-scope sample. Youths were very cooperative and interested in 
participating as evidenced by the very small number of refusals. Gatekeepers, or those 
individuals who provided access to the youth like caregivers, were more reluctant and account 
for the majority of non-interviews (see the discussion of challenges of the evaluation). 5 Response 
rates do not differ greatly between LST and control, with rates slightly higher for controls. Cases 
determined to be out of scope after sampling constitute more than 19 percent of the total sample. 
The largest category involves youths who were found to have been reunited with a parent or 
living with a legal guardian during the field period. 

More-detailed information on response and retention rates and out-of-scope conditions for the 
LST sample population is provided in appendix A. 

Youth Questionnaire. The youth questionnaire is the primary data collection tool used in the 
study. It provides the foundation for the impact study, but also offers critical information about 
youths’ backgrounds and experiences. The evaluation team designed the youth questionnaire 
primarily by using questions from existing surveys. The sources were selected to provide 
questions that had been used frequently and would provide good possibilities to compare with 
other samples. Four surveys provided the bulk of the questions. The Midwest Evaluation of the 
Adult Functioning of Former Foster Youth (the “Midwest study”) and the National Survey of 
Child and Adolescent Wellbeing (NSCAW) provided questions about child welfare and provided 
comparison samples of foster youths. In particular, the Midwest Study provided a good 
comparison sample of foster youths aging out of care. The National Fongitudinal Survey of 
Youth, 1997 cohort (NLSY97), and the National Fongitudinal Survey of Adolescent Health 
(AddHealth) provided many of the other questions and allowed comparisons with nationally 
representative samples of adolescents aging into their twenties. Special attention to the 
questionnaire design and selection of items was made so that the core questionnaire could be 
used with youths referred to independent living services at each selected site and so that the same 
questionnaire could be used in each round, with minor variations across rounds. FST and control 
youths were interviewed shortly after referral and random assignment, and follow-up interviews 
occurred one year and two years later. 

The questionnaire was designed to take approximately 90 minutes; actual average times were 
closer to 100 minutes. Most of the interview was conducted with the interviewer asking the 
questions and recording the youths’ responses on a laptop computer. Some sections of the 
questionnaire were administered with audio computer-assisted self-interviewing (ACASI) 
whereby the youths can either read the questions on the computer screen or listen to a recorded 
voice asking the questions. The computer faces the respondent and the interviewer does not see 
the youth’s responses. Sensitive sections of the interview were conducted with ACASI. 6 Where 
required, the questionnaire was adapted to specific program sites. For example, in Fos Angeles 



The distinction between youth refusals and caregiver refusals is murky. When caregivers told interviewers that 
the youth refused to do the interview, the interviewer tried to get the youth to indicate this to him or her directly, 
because caregivers frequently did not speak accurately for the youths. In cases where the caregiver would not 
allow us to speak with the youths, we coded the case as a gatekeeper refusal. 

6 The sections administered through ACASI were Substance Abuse, Sexual Behavior, Victimization, and 
Delinquency and Externalizing Behaviors. 
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County’s Life Skills Training program, staff administer a pre- and post-training life skills 
assessment to youths who participated in the courses. During the baseline interviews, the 
interviewer administered the paper self-completed pre-training questionnaire to youths assigned 
to the control group. 

Outcome Measures. Sections of the questionnaire served to identify the services received, short- 
and long-term outcomes, and moderating factors that influence the efficacy of the services 
received. Table 1.1 displays categories of data collection topics (sections of the questionnaire) by 
their purpose for analysis. These topics were primarily addressed in the surveys, though 
qualitative data collected during the process study (described below) also sheds light on some of 
these areas of interest. 

• Population Characteristics. The framework begins with the characteristics of the 
population of interest in each evaluation site, their demographics, and fixed factors, such 
as prior experiences in care and prior victimization. 

• Intervention and Services. The evaluation tests whether an intervention in the site alters 
outcomes of the treatment youths compared with youths receiving the usual services. We 
gathered information on both the focal independent living services (offered only to the 
treatment group) and the other services received by treatment and control group youths. 

• Moderating Factors. A set of factors was expected to moderate the effects of the 
interventions. These factors operate at many levels (the youths themselves, the family 
constellation, and the community). These are separated from the characteristics of the 
youths because they may change over time. 

• Short-Term (Intermediate) Outcomes. Early data collection after the intervention will 
establish the short-term outcomes of the treatment and control group youths. These 
outcomes may pick up progress on pathways to the final outcomes of interest (for 
example, education that will ultimately increase success in the labor market) or behaviors 
that affect ultimate outcomes (for example, sexual behaviors that affect fertility and 
health risks). 

• Longer-Term Outcomes. The ultimate goals of the interventions are related to successful 
functioning in adulthood. Key areas mentioned for the evaluation in the Foster Care 
Independence Act include educational attainment, employment, and “personal 
development.” The latter includes physical health, fertility, economic hardship, mental 
health, incarceration, and victimization. 



Table 1.1. Conceptual Framework for Data Collection and Analytic Purposes of 




Questionnaire Sections 






Population 

Characteristics 


Intervention and 
Services 


Moderating 

Factors 


Short-Term 

Outcomes 


Long-Term 

Outcomes 


Demographics 


Independent living 
services of interest 


^ . Employment and 

Relationships 

income 


Employment and 
Income 


Prior experiences 
in care 


Other services 


Social support 


Education 


Education 



9 





Table 1.1. Conceptual Framework for Data Collection and Analytic Purposes of 
Questionnaire Sections 



Population 


Intervention and 


Moderating 


Short-Term 


Long-Term 


Characteristics 


Services 


Factors 


Outcomes 


Outcomes 


Prior 

victimization 




Reading ability 


Health behaviors 


Physical health 






Living 

arrangements 


Substance abuse 


Fertility and 
family formation 










Economic 






Substance abuse 


Sexual behavior 


hardship or 
homelessness 






Pro-social and 
other activities 


Delinquency 


Mental health 






Mental health 


Mental health 


Victimization 






Attitudes and 
expectations 










Sense of 
preparedness 







Process Study 

A key component of the evaluation was examining how the programs under evaluation were 
implemented, commonly referred to as a process or implementation analysis. The process study 
played a key role in documenting the nature of the programs, interpreting the findings of the 
impact analysis, and suggesting directions for refining the impact study’s design. Specifically, 
the process analysis describes and analyzes the programs under evaluation by addressing two 
broad areas: the current and changing context and the implementation of the services. Each part 
of the process analysis from the site visits to observational analysis addressed one of these two 
areas. 

Program data have been collected to document the recruitment for and the receipt of services 
under the evaluation. The extent of the program data collected varies by program. However, it 
generally includes data on recruitment (e.g., successful and unsuccessful attempts), service 
participation (e.g., how much of the service the youth received, such as number of classes 
attended), and crossovers (i.e., control group youths who received the service under evaluation). 

To obtain an in-depth understanding of the programs under evaluation and the broader 
independent living services available to youths in both the control and the LST groups, site visits 
were conducted for each program under evaluation. During the visits, a number of 
semistructured interviews were conducted with administrators from the public child welfare 
agency, private agencies or organizations providing services to youths in the control and LST 
groups, and other key stakeholders. To gain a full understanding of services and operations from 
all relevant perspectives, semistructured interviews and focus groups were also conducted with 
caseworkers, supervisors, and independent living workers in the public child welfare agency and 
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with staff and administrators of the programs under evaluation. Focus groups were conducted 
with youths who had and had not received the services. In each site, members of the process 
study team also observed staff working with the programs under evaluation. 

Site visits were conducted in Los Angeles in October 2003 and August 2005. Table 1.2 lays out 
the types and numbers of respondents by qualitative method. Interviews and focus group 
protocols focused on the following areas (although not all topics were appropriate for all 
respondents): program planning, operational aspects, service delivery, and program assessment. 

During the first site visit in October 2003, six members of the evaluation team spent two weeks 
in Los Angeles. During this visit, the team met with administrators, supervisors, caseworkers, 
and independent living coordinators within the Los Angeles County Department of Children and 
Family Services to understand the broader independent living context in the county. The team 
conducted semistructured interviews and focus groups with staff from the LST program, 
operated under contract with Los Angeles County by The Community College Foundation 
(TCCF) to understand the programs under evaluation. Focus groups were conducted with youths 
who received LST services and with LST workshop instructors. Team members were also able to 
interview five community college program directors, several stakeholders involved with 
emancipation in Los Angeles County, and several service providers. Finally, the evaluation team 
conducted five observations of LST classes at three community colleges. 

For the second site visit, four members of the evaluation team spent a week in Los Angeles. The 
purpose of the first visit was to understand the broad context of independent living services and 
the programs under evaluation, and the aim of the second visit was to understand more fully how 
the programs operate. For this reason, the second visit contained more in-depth interviews with 
and observations of key program staff for each program. In addition, the team conducted 
interviews with key Department of Child and Family Services emancipation services staff, 
transition coordinators, and members of the Emancipation Program Partnership. Focus groups 
with foster youths were planned; however, these groups were poorly attended. After the visit, 
during September and October 2005, team members conducted hour-long individual phone 
interviews with those program staff who conducted outreach for the LST program. 

In preparation for the site visits, TCCF program documents and Department of Child and Family 
Services policies relevant to independent living were collected and reviewed. This document 
review has continued throughout the duration of the study in Los Angeles. 



Table 1 . 2 . LST Process Study Respondents in Los Angeles by Qualitative Method 




Type of Respondent 


First Site Visit 
(October 2003) 


Second Site Visit 
(August 2005) 


Respondents 
by Type («) 




DCFS administrators/managers 


5 


6 


11 


Individual 


TCCF program administrators/ 


3 


3 


6 


interviews 


managers 

TCCF program staff 


0 


11 


11 




Other stakeholders 


14 


4 


18 


Focus groups 


DCFS supervisors 


55 


0 


55 




DCFS workers 


54 


8 


62 




TCCF program staff 


21 


0 


21 



11 





Table 1.2. LST Process Study Respondents in Los Angeles by Qualitative Method 


Type of Respondent 


First Site Visit 
(October 2003) 


Second Site Visit 
(August 2005) 


Respondents 

by Type (n) 


Youths 


8 


8 


16 


Observations TCCF program staff 


3 


6 


9 


Respondents by site visit (ra) 


163 


46 


209 


Note : Los Angeles County; DCFS = Los Angeles County Department of Child and Family Services; TCCF = The 
Community College Foundation. 



As discussed earlier, program data were collected to document the recruitment for and receipt of 
services under the evaluation. For LST, data were collected on recruitment into workshops 
(noting the reasons a youth did not accept the service) and service participation (including 
attendance and graduation). These data were collected for youths assigned to the LST and 
control groups. Examining program data on control group members has allowed the evaluation 
team to identify violations of control group status. These data are presented in chapter 3. 



Evaluation Challenges 

To better understand the remainder of this report, it is important to briefly discuss some of the 
major challenges experienced throughout the evaluation. These challenges will be discussed in 
greater detail in appendix A, but it is necessary to outline some of them here. First, in any 
evaluation with an experimental design, there are inherent challenges in using administrative 
data to randomly assign participants, as well as in maintaining the random assignment (i.e., 
ensuring that participants in the control group do not receive the service or intervention and that 
participants in the LST group do). In addition, imposing upon established procedures in a given 
program is difficult. As will be discussed at length in chapter 2 and appendix A, the evaluation 
changed some of TCCF’s procedures, which proved challenging to maintain. Finally, the 
evaluation faced significant challenges due to inherent characteristics of the foster care 
population. Similar in some respects to other disadvantaged populations, youths in the foster care 
system are highly mobile both when they are in care and once they have been emancipated. 

These youths also have higher rates of mental health issues and behavioral issues. These 
difficulties are just a few of the many that make working with the foster care population 
challenging. 



Report Organization 

This chapter introduced the purpose and intent of the Multi-Site Evaluation, as well as an 
overview of the research design of the evaluation, including outcome measures. While the 
impact study is a critical part of the evaluation, it is important to first provide a better 
understanding of the design, context, and structure of the Life Skills Training Program, presented 
in chapter 2. 
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Chapter 2. Life Skills Training Program: Context, Description, and Operations 
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Introduction 



The information provided in this chapter plays an important role in the Multi-Site Evaluation. 
Describing the Life Skills Training (LST) program in detail, including program implementation, 
staffing, referral, recruitment, and services provided, offers an understanding of how the program 
operates. This information provides background needed to understand the results of the impact 
study. This chapter begins with an overview of the context within which the LST program 
operates, including state and local demographics, and local policies and practices for youth aging 
out of foster care. The discussion then presents logic models for the LST program and the 
context within which it operates. The chapter also includes a detailed description of the LST 
program, including staffing, referral, recruitment, and services provided. Linally, the chapter 
concludes with a discussion of some challenges to service provision. 

In examining the program’s implementation, it is important to keep in mind that social service 
programs often change and adapt to changing contexts as necessary. As a result, some 
descriptions may no longer reflect current operations. The programs may have changed 
operations, reporting structures, or forms used since the research team collected data. However, 
although this report points out some recent changes to the programs’ operations and structures, 
the focus is on the implementation and operation of the programs during the evaluation period. In 
other words, the process study captures the operation of the programs while the youths in the 
study were involved with them. It is important to understand how the programs were being 
implemented for the youths in the evaluation. The research team acknowledges that programs 
adapt and grow and has noted these developments whenever possible. 



Context for Evaluated Program 

To understand the LST program and the extent to which it has the intended impact for foster 
youth, it is critical to understand the context within which the program operates. The LST 
program operates within the larger context of Los Angeles County, posing a number of 
challenges that might affect outcomes for youths in the study, as well as program operations and 
implementation. The county’s size (both geographically and in population) and its diverse 
population are only two of many such factors. In particular, it is important to understand the 
demographics and nature of Los Angeles County, as well as any emancipation services in the 
county. The following section describes demographic characteristics of California and Los 
Angeles County, as well as the foster youth population in Los Angeles County. It also discusses 
other contextual factors that may affect the outcomes of youths in this study. A more in-depth 
description of the state and local context is provided in appendix B . 

State and Local Demographics 

California is the most populous state in the nation, with more than 35 million residents in 2004 
(table B.2). Slightly more than a quarter (27 percent) of the population is under the age of 18, 
and 35 percent of the total population is Latino. Just over 80 percent of the population age 25 and 
older are high school graduates, and 10 percent have less than a ninth-grade education. Nineteen 
percent of children under age 18 and 1 1 percent of families were living below the federal poverty 
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